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- DETAILED DESCRIPTION - A process for optimization problem solving in research, development 
and construction and for optimization of technical or chemical products and their production 
processes comprises collecting and processing all the values relevant to the optimization by a 
neural analysis based on self-organizing maps (SOMs), in which a topology producing, non-linear 
proje ction of data of the relevant parameter and the associated target values is performed on a 
multi- 8fflSiS5iS5SS! SOM. The target value is optimized by displaying as a SOM component map in 
either height coded or color coded form and, after selecting values for the target value, the 
underlying parameter combinations are calculated and output. 

- USE - For process optimization in vehicle and machine construction, in precision engineering, for 
development of genetic products and power plants and components. 

- ADVANTAGE - The process provides a data-based universal optimization process which permits 
simultaneous and continuous processing and display of all relevant optimization parameters and 
target values of technical or chemical products and their production processes and which provides a 
graphic display of the quality functions of the optimization. 

- DESCRIPTION OF DRAWING(S) - The drawing shows the essential components of a system for 
carrying out the process. 
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Die folgendan Angaben sind den vom Anmelder eingereichten Unterlagen entnommen 

Prufungsantrag gem. § 44 PatG ist gestellt 

(S) Verfahren zum Optimieren von Produkten und Produktionsprozessen 

@ DieErfindung beziehtsich auf ein Verfahren zur Losung 
allgemelner Optimierungsaufgaben in Forschung, Ent- 
wicklung und Konstruktion und zum Optimieren von tech- 
nischen oder chemischen Produkten und von Prozessen 
zur Herstellung dieser Produkte. Um eine gleichzeitige 
und zusammenhangende Bewertung relevanter Parame- 
ter und der dazugehorigen Zielgrdl^en zu ermdglichen, 
wird vorgeschlagen, die Einflusse der ProzeBgrdl^en 
■ durch eine neuronale Analyse auf der Grundlage selbstor- 
( g a nisi e render Karten in Beziehung zueinander auszuwer- 
I ten, indem eine topologieerhaltende, nichtlineare Projek- 
tion von Daten der Versuchsparameter auf eine 2-dimen- 
stonale neuronale Karte (sogenannter SOM) realisiert 
wird. Nach einer Auswahl von Werten der ZielgrofSe (Z1, 
Z2) auf der SOM-Komponentenkarte werden die zugrun- 
deliegenden Parameterkombinationen berechnet und 
ausgegeben. 
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Description 

The invention relates to a method for solving general 
optimisation tasks in research, development and design 
and for the optimisation of technical or chemical prod- 
ucts and of processes for manufacturing these products. 

The method is suitable for optimising design processes 
in mechanical and automotive engineering, in precision 
engineering or in development processes for genetically 
engineered products and for the optimisation of systems 
or parts of systems of a power station. 

It is generally known that numerical methods for opti- 
mising parameters are used for optimisation problems. 
Here, the starting point is a set N of independent 
variables pi, p2, ... ,Pvi, which are combined in a so- 
called parameter vector p: 

P = (Pl/ P2/ . • . / Pn) (1) 

The quality of such a parameter vector is described by 
a quality function Q. Q(p) therefore gives an indica- 
tion of how well the chosen parameter vector p solves 
the optimisation problem. In general, Q is defined in 
such a way that the optimisation problem is better 
solved the larger or smaller Q is. If it is assumed 
that a minimum Q represents the optimum, then a search 
is made for 



Q(p) -> Minimum 



(2) 
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Several methods of solution are knovm for this problem, 
which can be roughly divided into deterministic and 
random processes. Numerous deterministic methods, e.g. 
gradient methods and Newton methods, have the disadvan- 
5 tage in practice that partial derivations of the qual- 
ity function must be available for their solution. 
Other deterministic methods, e.g. direct search meth- 
ods, often become bogged down in the local extremes of 
their environment and do not find the desired global 

10 optimum, see J, Kahlert, "Fuzzy Control flir Inge- 
nieure", Vieweg Verlag, 1995, Pages 155 to 170. A 
strength of the classical optimisation methods - when 
they are applicable - consists in that they are able to 
find the optimum without having to have information on 

15 all areas. On the other hand, they lack universal ap- 
plication, as mathematical models are assumed. 

Further, it is known that, particularly in research, 
development and design, there are optimisation tasks, 

20 which cannot be solved by specifying a single quality 
criterion, but which consist of target functions, which 
have to be optimised simultaneously, and which often 
place contradictory requirements on the process. This 
results in a so-called vectorial quality function and 

25 the target conflict is dealt with formally by polyopti- 
misation methods, in the results of which a search is 
made for the best compromise solution. As a result, the 
above-mentioned problems of the existing optimisation 
methods are again intensified so that they cannot be 

30 used in many practical applications. 

Further, it is known that randomly controlled optimisa- 
tion methods, e.g. Monte Carlo methods or evolution 
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Strategies, are able to overcome the above-mentioned 
disadvantages; these have therefore been integrated 
into numerous practical applications. They assume that 
the scalar or vectorial quality function in the parame- 
5 ter space P constitutes a multi-dimensional mountain 
range, the minima or maxima respectively of which are 
to be found, see E. Schoneburg et al "Genetische Algo- 
rithmen und Evolutionsstrategien" , Addison Wesley Ver- 
lag, 1994, Pages 102 to 107 and Pages 141 to 215. 

10 

A disadvantage of this randomly controlled optimisation 
method is that one still has no or only very little in- 
formation about the make-up and the topology of the 
quality function Q in the state space P of the optimi- 

15 sat ion problem. In system theory, the n-dimensional 
vector space, in which the items of data to be investi- 
gated can be plotted above one another, is described as 
the state space P of a process. For example, a data ex- 
ample p corresponds to a point in this state space. In 

20 the following, an input space or state space P is un- 
derstood to mean exactly this state space. 

Furthermore, it is not know whether the optimum found 
is local or global. A further disadvantage lies in the 

25 correct parameterisation of the optimisation method it- 
self, as, for example, the initially simple concepts of 
evolution strategies or genetic algorithms have often 
become too complex for application in the technical or 
chemical process due to adaptive step width control, 

30 different crossing-over strategies or selection varia- 
tions (see E. Schoneberg et al.)- 
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The invention is based on the object of specifying a 
universal data-based optimisation method, which enables 
a simultaneous and consistent evaluation and visualisa- 
tion of all relevant optimisation parameters and target 
5 quantities of a technical or chemical product and of 
the process for the manufacture of this product, and 
which can clearly display the quality functions of the 
optimisation graphically. 



10 This problem is solved by a method specified in Claim 1 
for the optimisation of technical or chemical products 
and the optimisation of processes in research, develop- 
ment, design and production of these products. Here, 
all parameters relevant to a process are brought to- 

15 gether and evaluated in relation to one another by a 
neural analysis based on self -organising maps (so- 
called SOMs) , in which a topology-maintaining, non- 
linear projection of data, i.e. of all parameters and 
target quantities, of the relevant process is imple- 

20 mented on a multi-dimensional, height-coded or colour- 
coded neural map (SOM) . As the target quantities can be 
plotted on this structured SOM in the form of so-called 
component maps with height coding or colour coding, in- 
formation is obtained about the distribution of the 

25 target quantities in the whole of the parameter space 
P. The values of the target quantities that are sought, 
i.e. the minima, maxima and also particular ranges, can 
be selected and the associated parameter combinations 
determined by this means. 

30 

The only prerequisite for the method is the existence 
of example data for the optimisation problem. The 



.1 
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method thus constitutes an extension of existing opti- 
misation methods. 

The quality function for the optimisation can be a tar- 
get quantity itself or can be calculated from one or 
more target quantities. Starting from the graphical 
representation of the general high-dimensional quality 
mountains, information is obtained about the topology 
of the quality functions, and the global minima and 
maxima can easily be read from the mountains and the 
associated parameter combinations can be output. Fur- 
ther, it must be possible to superimpose individual 
scalar target quantity functions, i.e. individual tar- 
get quantity mountains, on one another so that a 
graphically orientated polyoptimisation can be carried 
out . 

Advantageous embodiments of the method are given in 
further claims. Due to the holistic approach, not only 
the values of individual parameters but also their mu- 
tual and non- linear effects on one another are taken 
into account . 

In the further description, a process is understood to 
mean any operation that has the objective of manufac- 
turing, improving or optimising something. A process 
can therefore be a technical or chemical process itself 
and also a process in research, development and design 
for the manufacture of a product or for the optimisa- 
tion of product characteristics. Process quantities are 
the quantities, which describe the process and are 
relevant to the optimisation task, e.g. design parame- 
ters, product characteristics or physical measurements. 
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A process in the above sense is described by the fol- 
lowing vector pvec of process cjuantities: 

5 pvec = (pi, P2/ . - . .Pi/ . . wPn/ Zi/ Z2, . . . / Zj, . . . , Zl) (3) 

where pi is the i-th influencing quantity or the i-th 
process parameter and Zj is the j-th target quantity of 
the process, i.e. the process quantities consist of pa- 

10 rameters and target quantities. The number n = N + L 
gives the total number of underlying quantities for the 
process. N is the number of influencing quantities, L 
is the number of target quantities; n is therefore the 
number of all relevant product or process quantities. 

15 The data vector is understood to be a concrete value of 
pvecti, which is measured at a point in time ti- The SOM 
method is applied based on existing data vectors from 
this process - 

20 In system theory, the n-dimensional vector space, in 
which the items of process data can be plotted with an 
assignment to one another, is described as the state 
space R of a process. If R is arranged so that an axis 
in R is assigned to each quantity, a point in R is ob- 

25 tained for each data example pvecti. Such a coordinate 
system R is described as the state space of the process 
and each process state pvecti at the time ti is marked 
as a point in R. In the following, an input space is 
understood to mean exactly this state space. The output 

30 space is the 2 -dimensional space, which is reproduced 
on the SOM map. A point in R therefore corresponds to 
each vector pvecti; a series of vectors represents a 
point cloud in R. The SOM method is applied based on 
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numerous data for the optimisation problem and thus on 
an above-mentioned point cloud. 

In neural theory, a self -organising map (SOM) is under- 
5 stood to mean a " self -organising neural network", in 
which all neurons are arranged adjacent to one another. 
The self -organising neural network is a term introduced 
for a special class of neural networks, which structure 
themselves based on input signals, cf. A. Zell "Simula- 

10 tion Neuronaler Netze", Addison Wesley Verlag, 1994, 
Pages 179 to 187. In contrast with conventional neural 
networks, the spatial position of the individual neu- 
rons and their neighbourhood relationships play an im- 
portant role in the SOM. The terms SOM and map are used 

15 with equal standing in the following. 

So-called topology-maintaining representations can be 
realised with the help of SOMs . In this context, topol- 
ogy-maintaining means that the points (data points) , 
20 which lie close together in the input space, will also 
lie close together in the output space and thus on the 
map. Therefore, in principle, the map represents a to- 
pology-maintaining, 2 -dimensional window in the n- 
dimensional state space of the process. 



In the method according to the invention, following an 
appropriate data pre-processing of the process quanti- 
ties, the values of the n quantities relevant to the 
optimisation task are provided in a learning phase to a 
30 self -organising network. The number of available data 
examples should not be less than a minimum number (MA) . 
This number is: 



25 
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MA 



= 30 



n 



(4) 



The method also works with fewer data examples, but 
this causes a degradation in the results. The value of 
5 n can lie between 2 and several hundred. Process quan- 
tity or measured quantity is understood to mean both 
the influencing parameters with the number N and the 
target quantities of the process with the number L. The 
number of target quantities should, however be consid- 
10 erably smaller than the number of influencing quanti- 
ties: 



15 The learning phase takes place in two steps: first, the 
map unfolds in the state space of the process and then 
the data examples are visualised by the application of 
a mathematical process. 

20 Before the learning method is used, the process quanti- 
ties are pre-conditioned. The individual quantities are 
first scaled to a predefined value and then the noise 
is removed, for example. Removal of the noise allows 
typified optimisation examples to be multiplied and 

2 5 further processed, as individual items of example data, 
which are always subject to a systematic and statisti- 
cal error, are generalised in this way. In doing so, 
the noise content must not be so large, however, that 
it qualitatively changes the existing data distribu- 

30 tions. 

The unfolding of the self -organising map in the state 
space of the process is realised by means of algorithms 



L << N. 



(5) 
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based on a neural algorithm according to T. Kohonen. 
The "self organising neural SOM algorithm" was intro- 
duced by Kohonen in 1982; cf. T. Kohonen "Self- 
organised formation of topologically correct feature 
5 maps" in Biological Cybernetics, 43, 59 to 69, 1982. 
Here, an n-dimensional weighting vector, which is it- 
eratively adapted by applying the method, is assigned 
to each neuron M on the SOM. Accordingly, each neuron M 
has a weighting vector w" with n elements: 

10 

= (Wi^, W2'', W3", . . . , Wi", . . . , Wn"") . (6) 

The number of elements or components of w therefore 
corresponds to the number of quantities n to be inves- 

15 tigated with n = N + L in Equation (3) . The number of 
neurons of an SOM is designated by k. An unfolded SOM 
network is generally shown as a rectangular map with 
X • y = k neurons; x designates the number of neurons in 
the x-direction and y the number in the y-direction. M 

20 is a selected neuron on the SOM with M = 1 ... k. 

The weighting vectors w of all neurons k are distrib- 
uted in the state space R by means of the algorithm. 
The SOM can organise itself on each n-dimensional 

25 structure (e.g. cuirve, surface or body), but can only 
implement an applicable and reproducible analysis of 
the process data by means of a modification of the 
method in accordance with the invention- Namely, two 
selected opposing corner neurons on the rectangular SOM 

3 0 map Ml and M2 are set to the minimum and maximum respec- 
tively of all process quantities in P and mathemati- 
cally fixed there by making the weighting vectors of 
these corner neurons w"^ and w"^ equal to the vectors for 



DE 197 42 906 A 1 
-li- 



the scaled minima and maxima of the process quantities. 
Minimum therefore means the closest to the origin of 
the coordinates in R and maximum the furthest from 
this. As a result of this, the map will unfold in a re- 
5 producible manner, as a rotation of the map in R can be 
avoided . 

The situation in the state space R is visualised using 
the U-matrix method or a dynamic visualisation method. 

10 

With the U-matrix method, the differences between the 
weighting vectors of each neuron with respect to its 
neighbour are calculated and displayed, appropriately 
graphically formatted, e.g. colour-coded. Connected ar- 

15 eas (e.g. light surfaces) have a small difference, as 
their neurons have been placed in close proximity to 
one another in the state space; between these individ- 
ual clusters there are boundaries, which are character- 
ised by a high difference between the respective 

20 weighting vectors; these are visualised as dark sur- 
faces, for example. In this way, a good visualisation 
of all cluster boundaries and thus the real process 
states can be achieved, see also G. Whittington, C. 
Spracklen: The Application of Neural Network Mode to 

25 Sensor Data Fusion in Proc . of Applications of ANN Con- 
ference, Orlando, USA, 1990. 

In the dynamic methods, the input vectors are again 
provided to the unfolded map in random order and the 
3 0 current winning neuron determined in accordance with a 
"winner-takes-all" algorithm. This algorithm states 
that the neuron, whose weighting vector is closest to 
the input vector, wins. The statement "closest" is de- 
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termined by calculating a previously specified dis- 
tance, e.g. the euclidic distance- The "winner- takes- 
all" algorithm is a method in which that neuron is al- 
ways selected, which best fulfils a certain condition; 
5 all other neurons of the network or of the map are in- 
active or not selected (1-from-k selection, where k is 
equal to the number of neurons on the map) . Here, this 
particular condition is a minimum distance between the 
current input vector and the weighting vector of the 
10 individual neurons, see S. Hafner, "Neuronale Netze in 
der Automat i s ierungstechnik " , Oldenbourg Verlag, 1994, 
in particular Pages 17 to 25. 

An internal counter, the winner rate, is increased by 

15 the numerical value 1 for the appropriate winning neu- 
ron. At the end of this dynamic visualisation, the win- 
ner rates for the individual neurons are receded into 
colour or brightness values, a higher numerical value 
meaning a light colour, for example. The neuron with 

20 the highest winner rate is shown in white. Neurons with 
correspondingly lower rates are shown darker, for exam- 
ple. Neurons, which have not won at all, are shown in 
black on the SOM. As a result of this algorithm, light 
surfaces appear on the SOM, which represent the sup- 

25 porting points of the SOM, as the weighting vectors of 
these neurons lie very close to the data examples to be 
learnt. The map must interpolate between these support- 
ing points. This visualisation method can therefore be 
used to build a security SOM. Values for the target 

30 quantities and the associated parameters on the light 
surfaces have a high reliability (security value near 
to 100%) and values on the intermediate dark surfaces 
have a lower reliability (security value considerably 
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less than 100%), as the map has interpolated there, A 
possible calculation for the security value SW is: 

SW = current winner rate of the neurons/max. winner 
5 rate • 100% (7) 

SW therefore specifies in percent how reliable the re- 
sults determined by the map are. The maximum winner 
rate is the largest winner rate, which a neuron on the 
10 map has in comparison with all other neurons - 

As a result of the above method, a structured SOM map 
is produced in which there is an association between 
the parameters p and the target quantities z. Here, an 

15 SOM neuron M, i.e. its weighting vector w", corresponds 
exactly to a point in R, i.e. one or more target quan- 
tities and the underlying influencing parameters. The 
positioning of the weighting vectors w in R for all 
neurons k of the map has been implemented by the self- 

2 0 organising learning process. At the same time, there 
are neurons, which represent the association between 
influencing and target quantities contained in the ex- 
ample data while other neurons specify unknown, non- 
linearly interpolated connections. 

25 

In the application phase of the map, the values of the 
target quantities or target quantity combinations that 
are of interest are sought out and the associated pa- 
rameter combinations are determined by selecting the 
30 neurons on the SOM belonging to the target quantities. 
This choice and selection can take place graphically, 
as the target quantities can be plotted on the SOM in 
colour or as mountains. 
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A further description of the method is given below with 
reference to the exemplary embodiments shown in the 
figures of the drawing - 

5 

In the drawing: 

Fig. 1 shows a structural diagram, which shows the main 
components of the system for carrying out the method, 

10 

Fig. 2 shows a possible weighting distribution of a 
neuron map in a process with only one influencing pa- 
rameter and one target quantity (n = 2) , 

15 Fig. 3 shows a neural colour-coded security map for 
modelling showing supporting points (white surfaces on 
the map) , 

Fig. 4 shows a neural height-coded component map for a 
20 target quantity of the process with a path that has 
been drawn in for desired values of the target quan- 
tity. 

Fig. 5 shows two neural height -coded component maps for 
25 two target quantities A and B of the process and a 
quality function C derived from this as a graphical, 
balanced superimposition of the two target quantities A 
and B for graphical polyoptimisation, 

30 Fig. 6 shows a block diagram for combining the SOM with 
feed-forward networks for verifying the results. 



10 



25 
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In the following, the description of the method is di- 
vided into different method steps and explained by 
means of the above Figures by way of example. 

Fig. 1 shows, by way of example, the structure of a 
system for carrying out the method for process analysis 
and diagnosis with a neural map. 

Method step 1 

Recording and selection of the process quantities 



VI. 1 Recording and formatting of the data. A data 
gathering and formatting system gathers and stores the 
15 process quantities required for optimisation. 

VI. 2 In a subsequent data analysis system, the se- 
lected and relevant data are subjected to a correlation 
analysis in order to determine the independent parame- 
20 ters. After this, the relevant quantities are scaled 
and, if necessary, noise is removed. 

VI. 3. Evaluation and analysis based on a neural sys- 
tem. 



Method step 2 
Map learning phase 



30 



V2 . 1 . Unfolding of the self -organising neural network 
in the state space of the process based on modified al- 
gorithm according to T. Kohonen. 
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Fig. 2 shows, by way of example, the weighting distri- 
bution of SOM neurons in a 2 -dimensional state space of 
the process with one influencing parameter (x-axis, 
w(i, 1) = wl^) and one target quantity (y-axis, (w(i,2) 
5 = w2^) . The consecutive number i (with i = l...k) speci- 
fies the selected neurons i of the SOM network and thus 
the selected 2 -dimensional weighting vector w^ . The po- 
sition of the weighting vectors w of the neurons is 
marked by a grey circle and the neighbourhood relation- 

10 ships - of the SOM neurons belonging to the appropriate 
weights - are shown by a line. Neurons, which are con- 
nected by a line, lie adjacent to one another on the 
SOM map. The white circles mark points at which data 
vectors are present . It can be seen that the largest 

15 part of the SOM neurons has been placed here, however 
there are also neurons, which lie between the data vec- 
tors; these interpolate between these data examples. 

V2.2. Visualisation of the unfolded network as a map 
20 by applying a dynamic visualisation method based on the 
appropriate winner rates of the neurons or by a statis- 
tical visualisation method according to the principle 
of the U-matrix method. 

2 5 Fig. 3 shows - here in black and white - by way of ex- 
ample, the structured and colour- coded, neural security 
map for the manufacturing process of part of a machine. 
It represents the projection and visualisation of 30 
process quantities on a neural map with 20 • 30 neurons. 

30 In Fig. 3, the x-axis specifies the number of neurons 
in the x-direction and the y-axis the number of neurons 
in the y-direction. In this example, the process quan- 
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tities consist of the target quantities torque and 
bearing temperature, and 2 8 influencing parameters. 

The light surfaces are the determined support points; 
5 values of the target quantity torque, which are calcu- 
lated at these points, are very reliable. The dark ar- 
eas on the map form the envelope between these support 
points, as they show neurons, which are arranged in the 
state space between the learned data. 

10 

Although, in this example, each process vector is de- 
termined by 28 independent parameters (e.g. hole diame- 
ter, bearing length, material roughness) and 2 target 
quantities (torque and bearing temperature) and is 

15 therefore 3 0 -dimensional , a topology-maintaining pro- 
jection can be carried out by means of the method on 
only two dimensions, the SOM map. The number of simul- 
taneously evaluated quantities is not restricted to 30; 
it can be considerably higher. The decisive factor is 

20 the topology-maintaining projection. In the above exam- 
ple, each target quantity represents a mountain on the 
28-dimensional parameter space and, although this moun- 
tain exists, it is not accessible by conventional meth- 
ods. The number of neurons does not depend a priori on 

25 the number of process quantities. The number of neurons 
should be chosen to be as large as possible; as a rule, 
it is restricted only by the computational power of the 
underlying neural system. 

3 0 By means of the SOM map, the underlying topological 
connections of the quality functions in the high- 
dimensional state space can be maintained and can be 
projected and visualised on 2 or 3 dimensions. An ob- 
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server thus obtains an insight into the structure of 
the high- dimensional mountain of the quality function 
or - as in the example - of a target quantity. 

5 As established, every neuron M on the map has a weight- 
ing vector with n elements, with w" = (wi", wa", 
. . . , Wi", . . . , Wn") . The i-th component of a weighting 
vector is designated by wi. A component map is produced 
by visualising the values wi^ of all neurons k of the 

10 map by means of the SOM. As the weighting values of 
each neuron can be unambiguously assigned to the value 
of the underlying process quantities, this representa- 
tion produces a distribution of the respective target 
quantity j over the whole state space of the process. 

15 When converting from the weighted value to the real 
value of the target quantity, it may be necessary to 
take account of the scaling. In the case of the moun- 
tain, the values so obtained by means of the SOM are 
visualised with height coding. It is equally possible 

20 to convert the value of the target quantity into a col- 
our value and to plot this on the SOM. The value of the 
target quantity can then be read off by means of an ap- 
propriate scale. 

25 Fig. 4 shows by way of example the height-coded moun- 
tain of the target quantity torque projected on an SOM. 
This picture is produced by building up a height -coded 
component map for the torque component. Here, the x and 
y-axis of the map represent the definition range of the 

30 target quantity and the z-axis represents the range of 
values of the target quantity, i.e. the associated 
value of the target quantity is calculated for every 
SOM neuron and plotted in a 3 -dimensional plot- It must 
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be noted that the definition range consists not - as is 
usually the case - of physical values of two influenc- 
ing parameters, but of all 2 8 influencing quantities 
simultaneously. These 28 influencing parameters have 
5 been shown together with the target quantities on the 
map in such a way as to maintain the topology. 



10 Application - optimisation of a target quantity of the 



As the real values of the target quantity can be plot- 
ted as mountains on the SOM, the required values can 

15 simply be marked on the mountains, and the associated 
parameter combinations can be output- Here, the target 
values can be plotted as contour lines, for example, on 
the mountains or it is possible to define a path P of 
permissible values on the target quantity mountains and 

20 to have all the associated parameter combinations for 
this path calculated from the SOM. Fig. 4 shows such a 
path - as a thick black line - on the mountains of a 
torque. The target value so defined lies at 700 when 
normalised. Furthermore, it is possible to select per- 

25 missible ranges Az = Zmax - Zmin for the target value. In 
the height -coded representation, this range corresponds 
to a tolerance width in the Z-direction; this range is 
therefore to be looked upon as a double section paral- 
lel to the x,y plane, once in the height Zmax and once 

30 for Zmin- 



Method step 3 



process 
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The basic idea is that the underlying optimisation pa- 
rameters can be determined starting from a required 
target value on the SOM. 

5 The reverse calculation from the target value to the 
parameter settings is therefore possible because an SOM 
neuron can be assigned to each value of the target 
value in the definition range. For example, the neuron 
M on the map is chosen for the required value Z2 in 

10 Fig. 4. By this selection of the neuron M, the appro- 
priate weighting vectors are output and converted 
into the real values of the process parameters. By this 
means, the sought-after parameter configurations, pi, 
P2/ Pn/ which have just led to the required target 

15 value, can be determined exactly. These parameter com- 
binations that have been found can be checked for plau- 
sibility by means of a subsequent procedure and, if re- 
quired, output to the process on-line or off-line. 

20 As the target value is graphically visualised by the 
mountains, it is also possible to select the minima or 
maxima of the target value without any difficulty; fur- 
ther, the embedding of this value in the context of 
other values can also be seen for the case where there 

2 5 are several ranges with the same values of the target 
quantity. Robust and error- tolerant optimisations can 
therefore be determined, as, in case of doubt, the tar- 
get value on a steep slope of the mountain, e.g. Zl in 
Fig. 4, would not be chosen if there were still an al- 

30 ternative on a plateau, e.g. Z2 in Fig. 4. Both points 
correspond to an equal numerical value of 800 for the 
target quantity, see Z-axis, but Z2 is considerably 
more stable. By this means, parameter combinations. 
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which in addition are still relatively robust with re- 
spect to small changes in the parameter values, are 
found for a required target quantity. 

5 Accordingly, the actual optimisation is carried out by 
selecting the required target values z on the SOM moun- 
tain and subsequently calculating the underlying pa- 
rameter combinations pi, Pn by means of the SOM 
map. The SOM map can therefore be used as an inverse 
10 model f with (pi, Pn) = f(zj). 

Furthermore, the selection of the required target value 
is made in the context of the whole of the target quan- 
tity mountains. In this way, for the case where there 
15 are several similar target values, those values can be 
found, which are most suitable for the optimisation 
task with regard to other characteristics. Most suit- 
able could, for example, be the most robust, as the 
target quantity lies on a plateau of the mountains. 



The search for minima or maxima is also very easy, as 
the position of a mountain MAX or a valley MIN can be 
seen from the mountains without any difficulty. A mini- 
mum or a maximum is found exactly at these points and 

25 the associated parameter combination can be output. The 
decisive factor is that the map can interpolate and 
that therefore target values, which were not present in 
the optimisation examples, can be displayed and se- 
lected. By this means, in conjunction with the context - 

30 dependent selection, it is possible to implement robust 
optimisations, which can be carried out without an un- 
derlying mathematical model and which are therefore 
universally applicable. 



20 
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Furthermore, if the results of the security SOM shown 
in Fig. 3 are used for the reliability of the SOM cal- 
culation, then it is also possible to discriminate be- 
5 tween reliable and unreliable optimisation results on 
the mountains. A conclusion can therefore be drawn as 
to how probable it is that the characteristics of the 
SOM mountain correspond with the reality in the state 
space P. Light areas of the mountain have a high level 
10 of reliability; dark depicted areas correspond to un- 
certain mountain characteristics. 

The plateaus of the target quantities are particularly 
interesting when robust optimisations are sought, i.e. 

15 optimisations in which changes in the influencing pa- 
rameters do not lead to serious changes of the target 
quantity. Particularly for this so-called error- 
tolerant optimisation, these plateaus are a completely 
new way of selecting parameters. It is generally appli- 

20 cable, non-linear and can be intuitively understood, as 
a target value on a plateau means that, for smaller 
changes of values of the influencing quantities, this 
will move about on the plateau and that, as a result, 
its numerical value will only change very slightly. On 

25 the other hand, the value of a target quantity (e.g. Zm, 
whose associated neuron M lies on the slope of a moun- 
tain, will respond very sensitively to changes in the 
influencing quantities pi, .../ Pn- Here, too, small 
changes of pi, Pn only have the effect that neurons 

3 0 around the original winner neuron M are selected; the 
values of the target quantity for these adjacent neu- 
rons can change greatly, however, as the value of their 
target quantity lies on a slope of the mountain. 
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Furthermore, it is possible to calculate a quality 
function Q based on the values of a target quantity and 
to display this instead of the target quantity itself. 



Application - Polyoptimisation of several target quan- 
tities 

In the case where several target quantities L have been 
trained with the map (2 < = L << N) , these target quan- 
tities can be evaluated together by introducing a qual- 
ity function G, which is calculated from several target 
quantities- As each target quantity can be represented 
as mountains on the map, a completely new set of moun- 
tains with modified characteristics is obtained by su- 
perimposing these mountains . The minima and maxima on 
these new mountains show that here, for example, the 
target quantity vector of all target quantities is 
minimum or maximum. By this means, the best compromises 
for the superimposed target quantities can be found. 

Fig. 5 shows an example in which the target quantity 
torque (Part A, Fig. 5) and bearing temperature (Part 
B, Fig. 5) have been superimposed. The resulting moun- 
tains GEB are shown in Part C of Fig. 5. There are sev- 
eral possibilities for this superimposition: on the one 
hand, a simple additive superimposition of the target 
quantities can be implemented by adding the L target 
quantity values, which are stored in the weighting vec- 
tor w of a neuron M, for each neuron M on the map: 



Method step 4 
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valuec 



M 



valuezi*^ + valuez2" + 



+ value 




+ 



+ 



valuSzL 



M 



(8) 



with M = 1 . . . k and valuec" as the value of the new 
5 quality function G - calculated from the vector - as 
the starting value for the j-th target quantity at po- 
sition M on the map. The result of a simple additive 
superimposed addition of the two target quantities 
torque and bearing temperature is shown in Part C of 
10 Fig. 5. 

On the other hand, it is also possible to weight cer- 
tain target quantities more than others. This is done 
by carrying out a weighted superimposed addition of the 
15 target quantities Zi, Z2, Zl. 

valuec"^ = ai • valuezi*^ + a2 • valuez2" + . . . + 
aL • valuezb" (9) 

20 In general, this allows any required quality function 
to be calculated from the target quantities with 

G = f(zi, Z2/ Zl) . (10) 

2 5 The function f can be any mathematical function. After 
calculating the new values valuec at all points on the 
map, i.e. for all neurons, and, if necessary, after 
subsequent scaling, the result is plotted once more as 
mountains GEB on the map. In this way, a universal op- 

30 timisation can be carried out for several target quan- 
tities simultaneously, as the underlying parameter com- 
binations can be calculated for each required target 
value according to (pi ... pN) = g(f(zi, Z2, Zl) ) 
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where g corresponds to an inverse mapping between the 
parameters P and the target quantities Z. The function 
g does not have to exist in the mathematical sense; it 
was determined by the SOM method during unfolding. 

5 

As the quality function G can also always be repre- 
sented as mountains GEB, the method constitutes an ex- 
tension of current methods for multi -quantity optimisa- 
tion (poly-optimum) in research, development and design 

10 and in industrial and chemical processes. The advantage 
is that a minimum or maximum, also of the compromise 
solution, can easily be determined graphically and the 
associated parameter combinations can be output in each 
case. The user only has to link together the target 

15 quantities of his choice and the resulting quality 
function will be displayed as new mountains. 

Method step 5 

20 Application - verification of the results of the analy- 
sis 

For verifying the parameter optimisation, a neural 
feed- forward network is used, which has modelled the 

2 5 same test process as the SOM. In contrast to the SOM, 
the inputs and outputs are treated separately in the 
neural feed- forward networks. All parameters, i.e. all 
influencing quantities for the optimisation, are ap- 
plied to the network inputs. All target quantities are 

30 connected to the network outputs. By using different 
neural learning methods, the network learns an approxi- 
mation between its inputs and outputs. The whole proc- 
ess can be modelled by this means. 
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A feed- forward network is a term introduced for a class 
of networks, the neurons of which are arranged in lay- 
ers and in which there are no feedbacks between neurons 
5 of a higher layer to neurons of a lower layer; see A. 
Zell, "Simulation Neuronaler Netze", Addison Wesley 
Verlag, 1st edition, 1994, Pages 76 to 78. These net- 
works are suitable for building up static and dynamic 
models between selected quantities. Starting from a 
10 neural model, which has been built up between the test 
parameters pi, P2/ Pn and the target quantity z j , 

this model can be used for verifying the parameter op- 
timisation . 

15 Fig. 6 clarifies the principle. Here, the feed-forward 
network model must be trained with the same test exam- 
ples as the SOM. A security - RBF - model is built up 
as a neural feed- forward network model. A security net- 
work is a network that, in addition to its model output 

20 value, specifies how reliable this model output value 
is. This reliability can, for example, be output by 
means of a numerical value of 0 ... 100%. Here 0% means 
no reliability, 100% means that the network result is 
completely reliable. 

25 

It is possible to build up such security networks when 
using suitable local approximating networks, e.g. RBF 
networks (see A. Zell, Pages 225 to 239) . RBF networks 
are 3 -layer networks, the hidden layer of which con- 
30 sists of neurons, which have a Gaussian activation 
function. Their maximum output activity is limited to a 
small input range. These neurons are therefore only 
sensitive for a small, n-dimensional , hyperspherical 
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input range. If the input vector lies in this range, 
the respective hidden neuron has its maximum output ac- 
tivity; the other hidden neurons have a correspondingly 
lower activity (see A. Zell) . 

5 

By calculating the magnitude of a distance between the 
applied input vector and the hidden neuron with maximum 
activity, a measure is obtained of whether the network 
is currently being used in a range in which it has not 

10 been trained. If the magnitude of this distance is 
large, this means that the input vector is a very long 
way from the supporting points of the RBF network. The 
result of the network is therefore relatively unreli- 
able, as neural networks interpolate between the 

15 learned supporting points. This interpolation is even 
more unreliable the further the value is from the near- 
est supporting points. If the current output value is 
in the extrapolation space, the result is even more un- 
reliable. 

20 

An example for calculating the security value SWrbf is: 
SWrbf[%] = activitywiNNER[%] - MSELearn[%] (11) 

25 where SWrbf is the reliability value of the network re- 
sponse in percent, activitywiNNER specifies the activity 
response of the winner neuron to an input value multi- 
plied by 100%, and MSELeam is the mean learning error of 
the network, recorded during the training. The security 

3 0 value can therefore not be greater than the accuracy 
during the learning process. The activity value is a 
measure of the distance from the input vector to the 
next learned supporting point. This results in a secu- 
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rity RBF network, which calculates and outputs not only 
the result of the simulation but also the reliability 
of the result . 

5 V5 . 1 . The optimum test parameters Pi(opt)/ .-•/ PN(opt) 
determined for a selected target quantity value Zj in 
Fig. 6 are fed to the security RBF network and the as- 
sociated target quantity Zj,TEST is determined. If Zj^TEST 
corresponds approximately to Zj, i.e. if the difference 

10 DIFF = I Zj - Zj^TEsxl is less than a pre-defined value OK, 
then the results of the SOM are verified, as the two 
underlying different neural models have calculated the 
same model results. N verified, optimum parameters 
Pi(opt)/ •-•/ PN(opt) have therefore been confirmed for the 

15 required target value. In the negative case, the selec- 
tion Zj^TEST must be repeated iteratively and the SOM or 
RBF model retrained. 

This means that, starting from the required target 
20 value Zj , the associated parameters are sought with the 
SOM and these results are verified with the security 
RBF network, as the respective parameters must again 
lead to the target value selected on the SOM. 

25 V5.2. In the case of polyoptimisation, the parameter 
combinations sought with the SOM for a compromise value 
(e.g. minimum or maximum) by means of the security RBF 
network must lead approximately to the individual val- 
ues of each target quantity selected on the SOM. 



Present optimisation methods can be extended by the 
combination of the target -orientated approach of the 
SOM with the verification possibilities of a feed- 



30 
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forward model, as the methods described here can be ap- 
plied non-linearly and universally, i.e. without an un- 
derlying mathematical model. In particular, optimisa- 
tions can be determined, which are robust with respect 
to changes in the optimisation parameters p. 

A further advantage of the method lies in the low engi- 
neering outlay. As the learning and structuring of the 
maps is produced completely by the method, extensive 
engineering or parameterisation of rules, models or 
differential equations can be dispensed with. The engi- 
neering is an integral part of the method itself- 
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Patent claims 



1. Method for solving optimisation tasks in research, 
development and design and for the optimisation of 
5 technical or chemical products and of processes for 
manufacturing these products, in which all the quanti- 
ties relevant to the optimisation are brought together 
and evaluated in relation to one another by a neural 
analysis based on self -organising maps, so-called SOMs, 

10 in which a topology-maintaining, non-linear projection 
of data of the relevant parameters and the associated 
target quantities is implemented on a mult i -dimensional 
SOM, this being visualised as an SOM component map for 
optimising a target quantity either height -coded in the 

15 form of mountains (GEB) or colour-coded, and after se- 
lecting values for the target quantity (Zl, Z2) on the 
SOM component map, the underlying parameter combina- 
tions are calculated and output. 

20 2. Method according to Claim 1, characterised in that 
products from mechanical and automotive engineering, 
system building, precision engineering and the chemical 
and genetic engineering industry are optimised as well 
as materials. 



3, Method according to Claim 2, characterised in that 
products from system building are power station engi- 
neering components . 

3 0 4. Method according to one of the preceding claims, 
characterised in that, in the case of a height -coded 
representation, the required values of a target quan- 
tity are selected by one or more contour lines on the 



25 
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target quantity mountains or by defining a path (P) , a 
range or a plateau on the mountains . 

5. Method according to one of the preceding claims, 
characterised in that the target quantity mountains are 
compared with the reliability values of a security SOM 
in order to identify the ranges on the SOM, which rep- 
resent the most reliable values for the optimisation. 



10 6. Method according to one of the preceding claims, 
characterised in that several target quantities are op- 
timised simultaneously and in conjunction with one an- 
other in the manner of a polyoptimisation by linking 
the selected target quantities with one another by 

15 means of any mathematical function and plotting the re- 
sulting quality function (G) as mountains (GEB) on the 
SOM and determining the underlying parameter values 
starting from the new mountains. 



20 7. Method according to Claim 4 or 6 , characterised in 
that contour lines, paths, ranges or plateaus are en- 
tered on the superimposed mountains (GEB) and the asso- 
ciated parameter combinations are determined. 



25 8. Method according to one of the preceding claims, 
characterised in that it is carried out in the follow- 
ing steps: 

a) Recording and selection of the test parameters 
and formatting of the data, 
30 b) Unfolding of the self -organising neural network 

in the state space of the process based on the 
SOM algorithm, wherein the values of the rele- 
vant test parameters are used. 
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c) Representation of the unfolded network as a neu- 
ral map , 

d) If necessary, projection of the high-dimensional 
parameter space on the neural map based on the 

5 U-matrix method or by means of so-called winner- 

takes-all algorithms with subsequent visualisa- 
tion of the summed winner rates of the individ- 
ual neurons on the map for building up a secu- 
rity SOM, 

10 e) Representation of the target quantities height- 

coded or colour- coded on the SOM, 

f) In the case of a height-coded representation: 
determination of contour lines, paths or ranges 
on the SOM for selecting the required values of 

15 the target quantities, 

g) Calculation of the underlying parameter combina- 
tions for the required target values, 

h) If necessary, weighted or unweighted superimpo- 
sition of the mountains of several target quan- 

20 tities and definition of the required ranges on 

the newly resulting target quantity distribution 
or quality function distribution. 

9. Method according to one of the preceding claims, 
25 characterised in that the results, which were obtained 
by means of the SOM, are verified by a subsequent secu- 
rity RBF model . 



30 In addition 5 page(s) of drawings 
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Abstract 

Method for optimising products and production processes 

5 The invention relates to a method for solving general 
optimisation tasks in research, development and design 
and for the optimisation of technical or chemical prod- 
ucts and of processes for manufacturing these products. 
In order to enable a simultaneous and consistent 

10 evaluation of relevant parameters and the associated 
target quantities, it is proposed that the effects of 
the process quantities be evaluated in relation to one 
another by a neural analysis based on self -organising 
maps, in which a topology-maintaining, non-linear pro- 

15 jection of data of the test parameters is implemented 
on a 2 -dimensional neural map (so-called SOM) . After 
selecting values for the target quantity (Zl, Z2) on 
the SOM component map, the underlying parameter combi- 
nations are calculated and output. 

20 
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